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DISPLAY AND ANALYSIS OF MULTICONTRAST-WEIGHTED 
MAGNETIC RESONANCE IMAGES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of U,S. Provisional patent application Serial 
No. 60/486,044 filed on July 10, 2003 and entitled DISPLAY AND ANALYSIS OF 
MULTICONTRAST-WEIGHTED MAGNETIC RESONANCE IMAGES"". 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH 
[0002] This invention was made with government support under Grant No, 
1RO1HL071021 awarded by the National Institute of Health. The United States Government 
has certain rights in this invention. 

BACKGROUND OF THE INVENTION 

[0003] The field of the invention is magnetic resonance imaging (MRI) methods and 
systems. More particularly, the invention relates to quantifying and classifying MRI images 
of atherosclerotic plaques (coronary artery, carotid artery, aorta, etc.). 
[0004] When a substance such as human tissue is subjected to a uniform magnetic field 
(polarizing field Bo), the individual magnetic moments of the spins in the tissue attempt to 
align with this polarizing field, but precess about it in random order at their characteristic 
Larmor firequency. If the substance, or tissue, is subjected to a magnetic field (excitation field 
Bi) which is in the x-y plane and which is near the Larmor frequency, the net aligned 
moment, Mz, may be rotated, or "tipped", into the x-y plane to produce a net transverse 
magnetic moment Mi. A signal is emitted by the excited spins after the excitation signal Bi is 
terminated, this signal may be received and processed to form an image. 
[00051 When utilizing these signals to produce images, magnetic field gradients (Gx Gy 
and Gz) are employed. Typically, the region to be imaged is scanned by a sequence of 
measurement cycles in which these gradients vary according to the particular localization 
method being used. The resulting set of received MR signals are digitized and processed to 
reconstruct the image using one of many well known reconstruction techniques. 
[0006] Coronary atherosclerosis is the main contributing factor to ischemic heart disease, 
the leading cause of mortality in developed countries. Characterization of atherosclerotic 
plaque structure in coronary arteries is an important factor in assessing susceptibility to acute 
coronary syndromes. Noninvasive computed tomography (CT) may provide differentiation 
between calcified and non-calcified plaques in patients at the expense of ionizing radiation 
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exposure. Noninvasive high-resolution MRI has been used in-vivo to monitor changes in 
burden and composition of human carotid arteries and aortic plaques. Multicontrast MRI as 
disclosed in U.S. patent No. 4,945,478 has been used for classification of atherosclerotic 
plaque components. Qualitative assessment of plaque composition using pattern recognition 
was performed on human aortas using T|, T2, and proton density weighted MR images. 
Normal wall (media), lipid-rich plaques, and fibrous plaques were differentiated with a 
clustering algorithm. 

[0007] Multicontrast MRI methods employ different pulse sequences to obtain multiple 
images of the subject artery. Each pulse sequence is chosen to *Veight" the reconstmcted 
magnitude image in such a manner that it highlights, or images, one of the atherosclerotic 
tissue class types involved in the disease process. To evaluate a disease such as 
atherosclerosis requires combining together structural information as well as fimctional 
mformation. Structural information includes characteristics of the vessel such as its shape in 
three dimensions, its location with respect to other structures, and its degree of vessel 
occlusion, or narrowing. Such stmctural information may be obtained fi^om any number of 
different MRI pulse sequences. Functional information involves identification and 
quantification of the various soft tissue types involved in the disease process. Functional 
information derived firom multicontrast MR images provides information regarding the 
physiological stage of the disease process. 

SUMMARY OF THE INVENTION 

[0008] The present invention is a multicontrast MRI method in which a plurality of 
images of a subject are acquired using a corresponding number of different pulse sequences 
chosen to contrast a corresponding number of tissue types; producing a different color image 
for each of the plurality of acquired images, combining the plurality of different color images 
to form a single, color composite MR image, and analyzing the color composite MR image to 
classify different components of the subject based on color. Cluster analysis may be used to 
segment the color composite MR image, where each subject component to be segmented is 
established by a preset range of color values determined by prior measurement of that 
component. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 is a block diagram of an MRI system which employs the present invention; 
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[0010] Fig. 2 is a flow chart of the steps in the preferred method of practicing the present 
invention; 

[0011] Fig. 3 is a pictorial representation of the cluster analysis step which forms part of 
the method of Fig. 2; 

[0012] Fig. 4 is an exemplary color composite image produced by the method of Fig. 2; 
[0013] Fig. 5 is an exemplary color composite image, a cluster image and a real image of 
a section of an artery after histological preparation and staining; 

[0014] Fig. 6 is a graphic illustration of a preferred pulse sequence performed by the MRI 
system of Fig. 1; 

[0015] Fig. 7 is a sequence of images A-H showing the steps employed to analyze a color 
composite image; and 

[0016] Fig. 8 is a table showing the results of different methods for identi^ng plaque 
components. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0017] Two embodiments of the invention are described, an ex-vivo embodiment using a 
very high field MRI system, and an in-vivo embodiment using a clinical MRI system. 
[001 8] The ex-vivo embodiment was perfomied on a Bruker 9.4T, 89 mm bore MR 
system with gradient system of 1000 mT/m and rise time of 100 \is (Bruker Instruments, 
Billerica, MA). Twelve human coronary artery specimens 1.28 cm long were imaged using a 
10 mm birdcage rf coil. 

[0019] The specimens were imaged at 37°C. Each specimen was washed and placed in a 

8 mm polyethylene tube, filled with Fomblin solution (perfluoropolyether, Ausimont USA 

Inc, Morristown, NJ) and sealed to prevent air bubbles. The use of Fomblin limits tissue 

dehydration and susceptibility effects on the surface of the specimen; it does not have residual 

MR signal and does not interfere with signal fi-om various biological tissue. MR imaging was 

performed using 3D fast spin-echo (FSE) sequence with isotropic voxel of 39x39x39 iim*^ 

(field-of-view (FOV) of 1.0 cm). Some of the samples were larger and required FOV of 1.28 

cm (voxel size of 50x50x50 |im^). A multicontrast-weighted series of images were acquired. 

A proton density weighted (PDW) image was acquired with a pulse repetition rate (TR) of 

2000 ms and an echo time (TE) of 9 ms. A Tl weighted (Tl W) image was then acquired 

with TR=500 ms and TE=9 ms, followed by a T2 weighted (T2W) image acquisition at 

TR=2000 ms and TE=25 ms. The FSE imaging was performed with an echo-train length of 4 
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and an acquisition matrix size of 256^. Acquisition time was 8 hours for PDW and T2W 
imaging and 2 hours for Tl W imaging. The position and size of the 3D volume was not 
changed from one MR acquisition (Tl W, PDW, T2W) to the other so that the three images 
are registered with each other spatially. 

[0020] Referring first to Fig. 1, there is shown the major components of a clinical MRI 
system which is employed to practice the in- vivo embodiment of the invention. In the 
preferred embodiment a 1.5T Siemens Sonata whole body MR system (Siemens AG, 
Erlanger, Germany) is employed with maximum gradient amplitude of 40 mT/m and slew 
rate of 200 mT/m/ms running Numaris 4.0. The operation of the system is controlled from an 
operator console 100 which includes a keyboard and control panel 102 and a display 104. 
The console 100 communicates through a link 116 with a separate computer system 107 that 
enables an operator to control the production and display of images on the screen 104. The 
computer system 107 includes a number of modules which conununicate with each other 
through a backplane. These include an image processor module 106, a CPU module 108 and 
a memory module 113, known in the art as a frame buffer for storing image data arrays. The 
computer system 107 is linked to a disk storage 1 1 1 and a tape drive 1 12 for storage of image 
data and programs, and it commimicates with a separate system control 122 through a high 
speed serial link 115. 

[0021] The system control 122 includes a set of modules coxmected together by a 

backplane. These include a CPU module 119 and a pulse generator module 121 which 

connects to the operator console 100 through a serial link 125. It is through this link 125 that 

the system control 122 receives commands from the operator which indicate the scan 

sequence that is to be performed. The pulse generator module 121 operates the system 

components to carry out the desired scan sequence. It produces data which indicates the 

timing, strength and shape of the RF pulses which are to be produced, and the timing of and 

length of the data acquisition window. The pulse generator module 121 connects to a set of 

gradient amplifiers 127, to indicate the timing and shape of the gradient pulses to be produced 

during the scan. The pulse generator module 121 also receives patient data from a 

physiological acquisition controller 129 that receives signals from a number of different 

sensors connected to the patient, such as ECG signals from electrodes or respiratory signals 

from a bellows. These signals are used to "gate" the acquisition when imaging moving 

subjects. And finally, the pulse generator module 121 connects to a scan room interface 

circuit 133 which receives signals from various sensors associated with the condition of the 
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patient and the magnet system. It is also through the scan room interface circuit 133 that a 
patient positioning system 134 receives commands to move the patient to the desired position 
for the scan. 

[0022] The gradient waveforms produced by the pulse generator module 121 are applied 
to a gradient amplifier system 127 comprised of Gx, Gy and Gz ampHfiers. Each gradient 
amplifier excites a corresponding gradient coil in an assembly generally designated 139 to 
produce the magnetic field gradients used for position encoding acquired signals. The 
gradient coil assembly 139 forms part of a magnet assembly 141 which includes a polarizing 
magnet 140 and a whole-body RF coil 152. A transceiver module 150 in the system control 
122 produces pulses which are amphfied by an RF amplifier 151 and coupled to the RF coil 
152 by a transmit/receive switch 154. The resulting MR signals radiated by the excited nuclei 
in the patient are received by a circularly polarized, six-channel body array local coil (not 
shown) and coupled through the transmit/receive switch 154 to separate chaxmels in a 
preampUfier 153. The amplified MR signals are demodulated, filtered, and digitized in the 
receiver section of the transceiver 1 50. The transmit/receive switch 1 54 is controlled by a 
signal fi-om the pulse generator module 121 to electrically connect the RF ampUfier 151 to the 
coil 152 during the transmit mode and to connect the preamplifier 153 to the local coil during 
the receive mode. 

[0023] The MR signals picked up by the local RF coil are digitized by the transceiver 
module 150 and transferred to a memory module 160 in the system control 122. When the 
scan is completed and an entire array of data has been acquired in the memory module 160, 
an array processor 161 operates to Fourier transform the data into an array of image data. 
This image data is conveyed through the serial link 1 15 to the computer system 107 where it 
is stored in the disk memory 1 1 1 . In response to commands received firom the operator 
console 100, this image data may be archived on the tape drive 1 12, or it may be fiirther 
• processed by the image processor 106 and conveyed to the operator console 100 and 
presented on the display 104. 

[0024] Referring particularly to Fig. 6, the fast spin echo MR pulse sequence employed to 

practice the preferred embodiment of the invention is a 2DFT RARE sequence in which four 

MR echo signals 301-304 are acquired. These MR echo signals are produced by a 90® RF 

excitation pulse 305 which is generated in the presence of a Gz slice select gradient pulse 306 

to provide transverse magnetization in a slice through the subject. This transverse 

magnetization is refocused by each of four selective 180® RF echo pulses 307 to produce the 
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MR spin echo signals 301-304 phase encoded by respective Gy phase encoding pulses 309- 
313. The magnitude of each phase encoding pulse is dififerent, and it is stepped through 256 
values to acquire 256 separate views during a complete scan. Each MR spin echo signal is 
acquired by digitizing 2S6 samples of each signals and as a result, at the completion of a scan 
for one image, a 256 by 256 pixel image is produced by performing a 2D Foiuier 
transformation on the acquired data. 

[0025] As with the above described ex-vivo embodiment, three images are acquired of 
the subject arteries using pulse sequences which weight the acquired MR signals differently. 
The scan parameters are selected to provide a proton density weighted (PDW) image, a Ti 
weighted (Tl W) image, and a T2 weighted (T2W) image. A double inversion recovery 
preparatory pulse sequence is employed prior to each FSE pulse sequence to suppress the 
signals from blood and cardiac gating is employed throughout the acquisitions to minimize 
vessel motion artifacts. 

[0026] It should be apparent to those skilled in the art that other pulse sequences may be 
used to acquire the multicontrast weighted images. For example, time-of-flight (TOF) MR, 
gradient-recalled echo T2 MR, Ti contrast MR magnetization transfer weighting, diffusion 
weighted MR, steady state free precision weighted MR and others may be used to enhance 
signals from particular tissue types of interest. As will be discussed below, by acquiring three 
differently weighted images of the subject, up to eight different tissue types are differentiated 
using the present invention. Additional images with different weighting characteristics may 
also be employed to increase the number and types of tissues that are differentiated, or fewer 
contrast images may be acquired to shorten the scan time when fewer tissue types need to be 
differentiated. 

[0027] The processing of the acquired ex-vivo and in- vivo images is the same. Referring 
particularly to Fig. 2 A, after the images are acquired as described above they are 
reconstmcted in the normal fashion (3DFT or 2DFT) to produce a set of three magnitude 
images as indicated at process block 200. These images may be displayed separately and the 
magnitude of each value therein controls the brightness of a corresponding pixel in a gray 
scale image of the subject. These gray scale images will differ from each other due to the 
different weighting factors used during their acquisition. 

[0028] The next step as indicated at process block 202 is to normalize each gray scale 

image such that each contributes equally to the composite color image to be formed in 

following steps. This is accomplished by setting the values of the brightest pixels in each 
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gray scale image to the same value and adjusting the values of the other pixels in their 
respective images a corresponding amount. This normalization step gives equal weight to the 
three images by giving their intensity values the same scale. 

[0029] As indicated at process block 204, the three, normalized gray scale images are 
then each mapped to a separate color chaimel. In the preferred embodiment, the PDW image 
is mapped to the green channel, the T2W image is mapped to the red channel, and the T2W 
image is mapped to the blue channel These three color images are then combined as 
indicated at process block 206 to form a single composite color image that may be displayed 
as indicated at process block 208 and as shown in Fig 4. The three colors optically combine 
at each image pixel to produce a displayable color indicative of the relative amounts of each 
color at that image pixel. In the ex-vivo embodiment the three color images are registered 
and tiieir combination is merely the mapping of corresponding pixel values in the three color 
images to the corresponding pixel in the composite color image. Because the subject may 
move during the in- vivo acquisition, the three color images may require a separate 
registration step prior to their combination. Nimierous registration methods which align 
features in anatomic images are known in the art and may be used if needed. 
[0030] While the display of the composite color image provides significant clinical 
information, this image can also be analyzed automatically as indicated at process block 210 
to provide quantitative information regarding the imaged tissue types. The objective method 
is preferred in order to segment and quantify plaque components. 

[0031] Referring particularly to Figs. 2B and 7, the analysis process begins by selecting a 
region of interest to be analyzed as indicated at process block 212. This is done by the user 
who selects a square region centered on the vessel of interest from the first slice in the study 
as shown in Fig. 7 A. As indicated by process block 214, the outline of the vessel lumen is 
then detected and the image is cropped around this detected lumen as shown in Figs. 7B and 
IC. This is performed on each slice in the study. An active contour (or "snake") method 
such as that described by Kass, M. et al: "Snakes: Active Contour Models", Int. Journal of 
Computer Vision 1 (1987) 321-331 is used. A snake consists of a set of points that define an 
elastic curve over which energy is defined. The system's overall energy is derived from the 
energy encapsulated in the snake model itself and the energy supplied from the image under 
consideration. Minimizing the system's energy function causes the active contour to 
converge to a stable state and reveal salient image characteristics as illustrated in Fig. 7A. 
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[0032] As indicated at process block 216, the region surrounding the vessel lumen is then 
segmented to identify the different tissue types present as shown in Fig, 7D- A cluster 
analysis method is used to segment the image into lumen, plaque and outer wall tissue 
components. Cluster analysis is an exploratory data-partitioning technique for solving 
classification problems of this type. Its aim is to sort data into groups, or clusters, so that the 
degree of association is strong between members of the same cluster and weak between 
members of different clusters. Each cluster thus describes, in temis of the data collected, the 
class to which its members belong. In the application of cluster analysis to the composite 
color image, data clusters serve to delineate the different tissue components according to their 
color. The K-means method of partitional cluster analysis described by Forgy, E. "Cluster 
analysis of multivariate data: Efficiency versus interpretability of classification", Biometric. 
1965; 21:768-780, is used in the preferred embodiment. 

[0033] Our implementation of cluster analysis exploits two aspects of the image pixel 
data, the image's color variance (cluster compactness in color space) and spatial infomiation 
(local pixel discontiguity) as described by Theiler J. Gisler G. "A Contiguity-Enhanced k- 
Means Clustering Algorithm For Unsupervised Multispectral Image Segmentation," Proc 
SPm 1997;3159:108-118. 

[0034] This method is illustrated in Fig. 3. The number of clusters, their seed points and 
associated tissue type for the cluster analysis algorithm were determined automatically for 
each MR image through the use of established ranges of color values for each of the tissue 
types. These ranges were obtained from the color composite MR images of a representative 
specimen. Presence of specific tissue components was determined automatically by matching 
pixel values within the image of interest to the representative color ranges, thus establishing 
number of clusters and values for their seed points. The defining color ranges for tissue types 
were only approximations and served to automatically initialize the number of clusters and 
seed points in the K-means cluster analysis of all specimens without reference to other image 
data or histopathology slices. The acceptable data metric (measure of degree of association 
between collections of pixels in color space) was the shortest distance in space (Euclidian). 
This data metric was applied to all MR images. 

[0035] Referring again to Figs. 2B and 7, the next step in the analysis process as indicated 

by process block 218 is to detect the outer border of the plaque. This is achieved as 

illustrated in Fig. 7E by radiating line-profiles of the clustered image outward from the center 

of the lumen. Each such line-profile indicates the radial distance between the lumen border 
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and the outer border of the plaque. From this information, area(s) where the plaque thickness 
deviates dramatically from the average plaque thickness is detected as indicated at process 
block 220 and illustrated in Fig. 7F. As indicated at process block 222, further cluster 
analysis is iteratively applied on such detected area(s) at varying scales to produce a well- 
defined plaque region as illustrated m Fig. 7G. This well-defined plaque region may then be 
extracted from the image as shown in Fig. 7H. When stacked with other cluster-analyzed 
color composite images in the study, a 3D image of the plaque is produced in which different 
colors indicate different plaque constituents. 

[00361 Since different atherosclerotic plaque components possess distinct signal strength 
in each of the Tl W, T2W and PDW MR images, the unanalyzed composite image has a 
distinct color distribution particular to the type of tissue present in the specimen as shown in 
Fig. 4. This image provides a qualitative means to assess plaque composition on specimens 
that span the entire range of AHA plaque types I-VL Table 1 shows the classification results. 
The agreement between manually traced histopathology and color composite or cluster- 
analyzed MR images was good or very good; the agreement between histopathology and 
conventional gray scale MR images (T2W) was moderate. The color composite method was 
capable of enhancing subtle variations in gray-scale luminance thereby making more evident 
various tissue components. An example of AHA type Vb-Vc plaque with the corresponding 
color composite MR image, cluster-analyzed color composite MR image, and histopathology 
is shown in Fig. 5. 

[0037] Table 1 . Qualitative Analysis of Coronary Plaques (AHA Classification) 



— -....^^^^ Parameter Name 
Comparison Type ^ — 


Cohen's Kappa 


Percent Of 
Agreement 


P-Value 


Histopathology Tracing 
& 

Cluster- Analyzed MRI 


0.89 


92 


<0.0001 


Histopathology Tracing 
& 

Color Composite MRI 


0.78 


83 


0.0001 


Histopathology Tracing 
& 

T2W Grayscale MRI 


0.42 


67 


0.0268 



Type I-m - isolated macrophage foam cells, intercellular lipid accumulation. 
Type IV- Va - lipid/necrotic core and fibrotic layer. 
Type Va-Vc - calcific or fibrotic. 
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Type VI - complex with surface defect, hematoma-hemorrhage, thrombus. 

[0038] Quantitative comparison data (correlation and Bland-Altman analysis) for each 
individual plaque component is shown in Fig. 8. Individual plaque components' areas are 
computed as a percentage of total wall area. There is a high degree of correlation between 
histopathology tracings and cluster-analyzed high-resolution MR images for the six identified 
tissue components (loose fibrous, media, dense fibrous, fibro-cellular (cap), thrombus, 
lipid/necrotic core). In this table: 
r = correlation value; 

bias - mean value of differences between paired measurements; and 
lim = limits of agreement between paired measurements (95% confidence 
interval), 

[0039] It should be apparent that variations are possible fi^om the preferred embodiment 
described above without departing from the spirit of the invention. For example, other 
imaging modalities may be used alone or in combination to acquire a plurality of images that 
are weighted for different plaque tissue types. Also, these separate weighted images are 
mapped to separate color channels in the preferred embodiment, but if analysis is to be 
performed, the magnitudes in these images can be viewed as separate components of a 
composite vector image which is formed by their combination. Analysis is performed on the 
composite vector image and the resulting identified tissue types may be displayed in different 
colors. 
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